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Abstract. We show that there are Cayley automatic groups that are not Cay- 
ley biautomatic. In addition, we show that there are Cayley automatic groups 
with undecidable Conjugacy Problem and that the Isomorphism Problem is 
undecidable in the clas of Cayley automatic groups. 



1. Introduction 



The notion of automatic groups, based on ideas of Thurston, Cannon, Gilman, 
Epstein and Holt, was introduced in [ECH + 92 . The initial motivation was to un- 



derstand the fundamental groups of compact 3-manifolds and make them tractable 
for computing. It was quickly realized that automatic group come short in dealing 
with manifolds of Nil and Sol types. This immediately triggered a search for suit- 
able generalizations. In [BG96 Bridson and Gilman came up with a sufficiently 
powerful notion of automaticity (asynchronously automatic groups where regular 
languages are replaced with indexed languages) that covers all fundamental groups 
of compact 3-manifolds, but at the cost of losing all the nice algorithmic properties. 

Since 1990's a lot of groups were proved to be automatic (see the survey in 
KKMllj). but one frustration still lingers there. It turns out that many basic 
questions on automatic groups remain wide open despite a considerable effort by 
the group theoretic community. Three such basic problems ask if automatic groups 
are biautomatic, if they have a decidable Conjugacy Problem, and if the Isomor- 
phism Problem is decidable within the class. The Cayley automatic groups, intro- 
duced in KKM1I retain the basic algorithmic properties of the standard automatic 
groups (decidability of the Word Problem in quadratic time and decidability of the 
Conjugacy Problem in the biautomatic case) but form a much wider class of groups, 
which, in particular, contains many nilpotent and solvable groups, which are not 
automatic under the standard definition. From the algorithmic view-point this 
indicates that the new class gives a legitimate notion of automaticity. Another 
confirmation that Cayley automatic groups provide a robust generalization of the 
standard automatic groups is given by the fact that the basic problems mentioned 
above can be tamed in this case. Namely, we show that all three have a negative 
solution in the class of Cayley automatic groups. 

Theorem 1. There are Cayley automatic groups that are not Cayley biautomatic. 

This answers a question raised implicitly at the end of the introductory section 
in [KKMll] . The theorem below answers a question raised implicitly at the end 
of Section 8 in [KKMllj . 

Theorem 2. There are Cayley automatic groups with undecidable Conjugacy Prob- 
lem. 
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Our last result concerns the Isomoprhism Problem. 

Theorem 3. The Isomorphism Problem is not decidable in the class of Cayley 
automatic groups. 

Our results follow from several results of Kharlampovich, Khoussainov, and Mi- 
asnikov |KKMllj . Bogopolski, Martino, and Ventura [BMV10] . and Levitt |Lev08j . 

Bogopolski, Martino, and Ventura proved that certain group extensions have 
decidable Conjugacy Problem (here and thereafter F n denotes the free group of 
rank n) . 

Theorem 4 (Corollary 7.6. BMV10 ). There exists a group of the form 1 d x r F n 
with undecidable Conjugacy Problem. 

The homomorphism r : F n — > GLd(Z) constructed in the proof of Theorem [3] 
in BMV10 is not injective. In fact, the image r(F n ) is not finitely presented and the 
question of existence of a group of the form H l x T F n with undecidable Conjugacy 
Problem such that r(F n ) is finitely presented was left op en. A modification of the 



construction from [BMVlOj that was provided in [SV10 resolved this question 



Theorem 5 ( [SVIO] ). There exists a group of the form Z d x T F n with undecidable 
Conjugacy Problem such that r is injective. 



The primary goal of [SVIO] was to prove that the Conjugacy Problem is not 
decidable in the class of automaton groups (these are self-similar groups of rooted 
regular tree automorphisms generated by finite, invertible, synchronous transduc- 
ers; see [GNSOO] ). The class of automaton groups should not be confused with the 
class of automatic groups, as defined in [ECH + 92| . nor with its generalization, the 
Cayley automatic groups, as defined in [KKMll] . At present, the relation between 
the class of automaton groups and the class of Cayley automatic groups is not clear 
and only the latter is the subject of consideration in this work. 

The final ingredient in the proof of Theorem [2] is Theorem [51 which is not stated 
in [KKMll] in the form in which we quote it here, but it is a corollary of the other 
results presented there. Theorem [2] directly follows from Theorem [4] and Theorem [6] 

Theorem 6 ([KKMll ). All groups of the form 1 d x F n are Cayley automatic. 

As a direct corollary of Theorem [2] and the following result, we obtain Theorem [T] 

Theorem 7 (Theorem 8.5. KKMll ). Cayley biautomatic groups have decidable 
Conjugacy Problem. 

As a direct corollary of Theorem [5] and the following result of Levitt, we obtain 
Theorem [3) 

Theorem 8 f |Lev08] ). The Isomorphism Problem is not decidable in the class of 
groups of the form Z d x F n . 

It is important to observe that our examples of Cayley automatic groups that 
are not biautomatic and have undecidable Conjugacy Problem are not automatic 
in the standard sense. Indeed, one can prove the following. 

Theorem 9. If a group of the form Z d xi F n has subexponential Dehn function, 
then it has decidable Conjugacy Problem. 

In the remaining sections we provide the necessary definitions and other details. 
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2. CAYLEY AUTOMATIC AND CAYLEY BIAUTOMATIC GROUPS 

Let E be a finite alphabet. We will sometimes extend this alphabet by a special 
symbol o that is not in E, and we denote E, = EU {o}. 

For an n-tuple of words (u>i , . . . , w n ) over E define the convolution ®(w\ , . . . , w n ) 
to be the word of length max{|wi|, . . . , \w n \} over (E<>)™ in which the j-th symbol 
is (cti, . . . , <7„), where 

J the j-th symbol of Wi, if j < \uii\ 
| o, otherwise 



For instance, 



'a 

(aaa, babaa, 0) = I b 



, o 




where denotes the empty word and the symbols in (E<>)™ are written, for conve- 
nience, as columns. 

Let R be an n-ary relation on £*. The convolution ®R of R is the language over 
(S )" defined by 

®R = { <8>(wi, . . .,w n ) | (wi,. . .,w n ) G R }. 

A relation i? is regular over E if its convolution ®i? is a regular language over 
(E )", i.e., (8>i? is recognizable by a finite automaton over the alphabet (E<>)" (let 
us note that, in this work, the automata always read words from left to right). 

Let 67 be a finitely generated group with finite generating set S. The right 
Cayley graph of G with respect to S is the graph T(G, S) with G as the set of 
vertices and, for each g in G and s in S, an edge from g to gs. The Cayley graph 
can be interpreted as a system of IS 1 ] binary relations E s on G, for s in S, where 

E s = { (g,gs) \geG}. 

A map ~ : G — > E* induces |5| binary relations on E* given by 

E s = { (g,gs) IffeG}. 

Definition 1. A finitely generated group G with finite generating set S is Cayley 
automatic if there exists a finite alphabet E and an injective map ~ : G — > E* such 
that 

G is regular (over E) and 

E s is regular (over E), for every s in S. 

In such a case the tuple (G, E Sl , . . . , E Sk ) is called an automatic structure of 
the Cayley graph T(G, 5) or Cayley automatic structure of G (with respect to 
S = {si, . . . ,sfc}). 

In addition to the right Cayley graph one may consider the left Cayley graph 
r £ (G, S) as well. The vertex set is G and, for each g in G and s in S, an edge 
from g to sg. The left Cayley graph can be interpreted as a system of \S\ binary 
relations E% on G, for s in S, where 

E e s = {(g,sg)\g€G}. 
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Definition 2. A finitely generated group G with finite generating set S is Cayley 
biautomatic if there exists a finite alphabet E and an injective map : G — > E* 
such that 

G is regular (over E), 

E s is regular (over E), for every s in 5*, and 
E s is regular (over E), for every s in S. 

In such a case the tuple (G, E S1 , . . . , E Sk , K s , . . . , ) is called a biautomatic 
structure of the pair of Cayley graphs T(G, S) and F (G, S) or Cayley biautomatic 
structure of G (with respect to S = {si, . . . , Sfc}). 

It is important to observe that being Cayley automatic is property of the group 
and does not depend on the chosen finite generating set S, i.e., G is Cayley au- 
tomatic with respect to a finite generating S if and only if it is Cayley automatic 
with respect to any of its other finite generating sets (Theorem 6.9. |KKMll] ). 

All (bi)automatic groups, as define d in [EC H±92] are Cayley (b i) automatic 
(Proposition 7.3. and Proposition 8.4. |KKMll] ). The class of Cayley automatic 
groups is much wider than the class of automatic groups. For instance, it includes 
the Heisenberg group H = (a,b \ [a, [a, b]] — [b, [a, b]] = 1} and many other nilpotent 
groups that are not automatic (Example 6.6 [KKM11 ). Nevertheless, the class of 
Cayley (bi) automatic groups retains many algorithmic properties of (bi) automatic 
groups. For instance, every Cayley automatic group has Word Problem dccidable 
in quadratic time and every Cayley biautomatic group has decidable Conjugacy 
Problem (Theorem 8.2. and Theorem 8.5. jKKMllj ). 

The class of Cayley automatic groups has good closure properties. The following 
is, in particular, relevant for our purposes. 

Theorem 10 (Theorem 10.3 |KKMll| ). Let A and B be graph automatic groups 
with finite generating sets X and Y , respectively. Let r : B — s> Aut(A) be a homo- 
morphism such that the automorphism r{y) is automatic for every y in Y . Then 
the semidirect product G = A X T B is Cayley automatic. 

By definition, an automorphism a of the Cayley automatic group A, which is 
automatic over E, is automatic if the graph relation a = {(a,a a ) \ a G ^4} induced 
by a is a regular relation over E. 

The semidirect product A x T B is the set of all pairs (b,a), for b 6 B, a G A, 
with product defined by (fix, ai)(&2, 0,2) — (bib2,a^ b2 ^a 2 ). 

It is known that the free abelian group A = Z rf and the free group B = F n of 
finite ranks are automatic, and hence they are Cayley automatic. The argument in 
the proof of Proposition 10.5 in [KKMll] . showing that every automorphism of Z 2 
is automatic, can be extended to show that every automorphism of II 1 is automatic. 
In other words, multiplication of c?-tuples of integers by any fixed d x d matrix in 
GLd(Z) is automatic. These observations, together with Theorem ITOl immediately 
imply Theorem [6] 

3. (Free-abelian)-by-free groups with undecidable Conjugacy 

Problem 

For the duration of this section, let A — 7L d and B = F n (this agreement is not 
crucial for all statements, but this is the setting we are aiming for and there is no 
need to go into more general considerations). 
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Let C be a subgroup of Aut(A) = GL(j(Z). We say that C has undecidable Orbit 
Problem if there is no algorithm that decides, on input consisting of arbitrary pair 
of vectors u and v in A, if there exists a matrix c in C such that u c = v (we use 
the right action of matrices on vectors; this is just the multiplication of vectors by 
the matrix c on the right). Let r : B — > GL^Z) be a homomorphism such that 
t(B) = C. If C has undecidable Orbit Problem then G = A x r B has undecidable 
Conjugacy Problem. Indeed, as observed in [B MVlOj . two vectors u and v in A 
are conjugate in G if and only if they are in the same orbit under the action of 
C = t(B), and since the latter problem is undecidable, so is the Conjugacy Problem 
in G. 

A good way to construct orbit undecidable subgroups of GL<j(Z) is provided 
in BMV10 (Section 7; in particular, Proposition 7.5. and Corollary 7.6., the latter 
of which is listed in our introduction as Theorem SJ . Let d > 4 and let H be 
a finitely presented group with undecidable Word Problem. Use the Mikhailova 
construction to obtain the corresponding finitely generated subgroup H' of F2 X F% 
with undecidable Membership Problem and then consider F2 x F% as a subgroup of 
GLrf(Z) through a specific embedding (F2 x F2 embeds in GLd(Z), for d > 4) that 
turns the undecidability of the Word Problem in H into undecidability of the Orbit 
Problem for H' — C < GL^Z) (a specific embedding of F2 x F2 with this property 
is spelled out precisely in |BMV10| L The group G = A>o T B, where r : B ->■ GL d (Z) 
is any homomorphism with t(B) = C, has undecidable Conjugacy Problem. 

The group C, as defined above, is finitely generated and not finitely presented. 
Thus, r is not injective for any group of the form G = A » T B with C = t(B) as 
in the above construction. 

The following modification, introduced in |SV10) . provides groups of the form 
G = A x T B with undecidable Conjugacy Problem and injective r. Let C = 
(gi, . . . , g n ) be an orbit undecidable subgroup of GLrf(Z), let B = F(fi, . . . , /„) be 
free of rank n, and let C = (g[, . . . ,g' n ) be any free subgroup of rank n of GI_2(Z) 
(such subgroups do exist for any rank). Define r : B —> GL,j + 2(Z) by 



gi 0dx2 

2 xd g'i 



for i = 1, . . . , n, where 0rf X 2 and C^xd are the zero matrices of appropriate sizes. In 
other words, the action of r(/i) on the first d coordinates of 1 d+2 is the same as the 
action of the matrix gi , and on the last two coordinates as the action of the matrix 
<?'. It is clear that r is injective (since it is injective "on the last two coordinates"). 
Moreover, the undecidability of the Orbit Problem for C in GLrf(Z) induces the 
undecidabiluty of the Orbit Problem for the free subgroup C = t(B) in GLd+2(Z) 



(see Proposition 1 in SVlOj , which is listed as Theorem [5] in our introduction) 



At the end, we show that our examples of Cayley automatic groups that are not 
Cayley biautomatic and have undecidable Conjugacy Problem are not automatic 
under the standard definition. In fact, Theorem [9] claims that they cannot even 
have subcxponcntial Dchn functions. 



Proof of Theorem^ Let G = Z d x r F n be a group with subexponential Dehn func- 
tion. Bridson showed that the Dehn function of G can be either polynomial or 
exponential and the former is possible only when F n has a subgroup F' of finite 
index such that t(F') is unipotent . This implies that r(F n ) is virtually 
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solvable. Since virtually solvable subgroups of GLrf(Z) have decidable Orbit Prob- 
lem, it follows that G has decidable Conjugacy Problem (see Proposition 6.9 and 
Corollary 6.10 in [RMV10]). * □ 
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